ON SLOW-FADING NON-SEPARABLE CORRELATION 

MIMO SYSTEMS 



R. RASHIDI FAR, T. ORABY, W. BRYC*, AND R. SPEICHER+ 

Abstract. In a frequency selective slow- fading channel in a MIMO 
system, the channel matrix is of the form of a block matrix. We 
propose a method to calculate the limit of the eigenvalue distri- 
bution of block matrices if the size of the blocks tends to infinity. 
We will also calculate the asymptotic eigenvalue distribution of 
HH*, where the entries of H are jointly Gaussian, with a corre- 
lation of the form E[hpjhqk] — J2l=i ^^fk^pq (where t is fixed 
and does not increase with the size of the matrix). We will use 
an operator-valued free probability approach to achieve this goal. 
Using this method, we derive a system of equations, which can be 
solved numerically to compute the desired eigenvalue distribution. 
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1. Introduction 

With the introduction of some sophisticated communication tech- 
niques such as CDMA (Code-Division Multiple-Access) and MIMO 
(Multiple-Input Multiple-Output), the communications community has 
been looking into analyzing different aspects of these systems, ranging 
from the channel capacity to the structure of the receiver. It has been 
shown that the channel matrix plays a key role in the capacity of the 
channel pj,i2j as well as in the structure of the optimum receiver [31 13]. 
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More precisely, the eigenvalue distribution of the channel matrix is the 
factor of interest in different applications. 

Free probability O [H [7] and random matrix theory have proven to 
provide the right kind of tools in tackling such kind of problems [SI [9]. 
For example, Tse and Zeitouni pJ]J applied random matrix theory to 
study linear multiuser receivers, Moustakas et. al. [11] applied it to 
calculate the capacity of a MIMO channel. Miiller Muller-02,Muller- 
02a employed it in calculating the eigenvalue distribution of a particular 
fading channel and later Debbah and Miiller ^14] applied it in MIMO 
channel modeling. 

There are, however, also many interesting (more realistic) models for 
the channel matrix, which are not directly accessible with the usual free 
probability or random matrix techniques. Let us be a bit more specific 
on such examples. For a MIMO wireless system with ut transmitter 
antenna and ur receiver antenna, the received signal at time index n, 
Yn = [yi,n, ■ ■ ■ , ynn,nf. wiU bc as follows: 



(1) 



F„ = HX,, + iV„, 



where H is the channel matrix, Xr, 



is the trans- 



mitted signal at time n and Nn is the noise signal. The channel matrix 
entries hij reflect the channel effect on the signal transmitted from an- 
tenna j in the transmitter and received at antenna i in the receiver. In 
a more realistic channel modeling, one may consider the Intersymbol- 
Interference (ISI) [T5l Chapter 2]. In this case, the channel impulse 
response between the transmitter antenna j and the receiver antenna 

T 



i is a vector h 



h 



where L is the 



h^ - ,, - - - ,, 

"■1 "-2 "-L-l "-L 

length of the impulse response of the channel (number of the taps). 
Consequently, the channel matrix for a signal frame of K will be as 
follows: 



(2) H 



Al A2 ■■■ Al 

Al A2 ■■■ Al 

Al A2 ■■■ Al 











Al A2 










Al 



I I 



where there are K—\ zero- matrices in each row and Ai = {h^ j j=i,... ,,1^ 

j=l,--- ,nT 

(see Fig. [T]for the block diagram). To calculate the capacity of such a 
channel, one needs to know the eigenvalue distribution of the HH* [8j. 

The above random matrix falls into the class of random matrices 
where one has correlations between the entries of H. Whereas random 
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matrices with independent entries are quite well understood and there 
exist many analytic results on their asymptotic eigenvalue distribution, 
only very special cases of the correlated situation could be treated in 
the literature. The most prominent of those is the case of separable 
correlation, where the covariance between the entries of H = {hij)ij 
factorizes as E[hpjhqk] = where and \E'^ are matrices de- 

scribing the transmit and the receive correlation, respectively. Our 
block matrix H from Eq. ([2]) does not fall into this class. 

In this paper, we will show how a more general version of free proba- 
bility theory, so-called "operator valued free probability theory" allows 
to deal with more general situations of correlated entries. In particular, 
we will treat the case of block matrices, as the above H from Eq. ([2]), 
and also extend results from p!6] from the case of separable correlations 
to the more general situation 



The results for the asymptotic eigenvalue distribution of HH* for these 
two cases are stated in Section [2], in Theorems [1] and [2l The proof of 
Theorem [1] is given in Section [3l as a consequence of a corresponding 
statement. Theorem [3l for selfadjoint matrices X. We will show that 
these selfadjoint matrices are asymptotically described by operator- 
valued semicircular elements, and the equation describing the limiting 
Cauchy transform of X follows then from the general theory of semi- 
circular elements. In Appendix I we state the main notions and results 
in relation with operator-valued semicircular elements. In Appendix II 
we prove Theorem [2], again by showing that a corresponding selfadjoint 
matrix X is asymptotically an operator- valued semicircular element. 
In Appendix III we state a more general version of Theorem [3l for the 
situation where the blocks are not necessarily square matrices. 

2. Asymptotic eigenvalue distribution of HH* 

In this section we will present our main results on the asymptotic 
eigenvalue distribution for HH* where if is a non-selfadjoint Gaussian 
random matrix with some specific kind of correlation between its en- 
tries. We will treat the block matrix case and the case of non-separable 
correlation. The proof of these theorems will be provided in the next 
section and in the appendix. An application to the asymptotic eigen- 
value distribution of channel matrices of the form ([2]) will be given in 
Section HI 



(3) 




s=l 
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2.1. HH* for block matrices. Our main theorem on block channel 
matrices is the following. For used notation, see Section 15.11 

Theorem 1. Fix natural h and a and a real valued "covariance func- 
tion" T{i, k;j, I) such that T{i, k;j, I) = T{j, l;i,k),i,j = l,...,a;k,l = 
1, . . . , 6. Assume, forN G N, that {hrp''^ \ i = 1, . . . ,a, k = 1, . . . ,b, r,p 
1, . . . , A^} are jointly Gaussian complex random variables, with the pre- 
scription of mean zero and covariance 

(4) E\h^^}^^^] = J^^^SrsS,,-T{t,k;j,l). 

We also assume circular complex Gaussian law, i.e, E[{hrp''^y] = 0. 
Gonsider now block matrices = (if'-*''^^) i=i,...,a , where, for each 

k — l,...,b 

i = 1, . . . ,a and k = 1, . . . ,b, the blocks are given by H^^'^^ = [hip''^^ ^ 

Then, for N oo, the aN x aN matrix HnH^ has almost surely 
a limiting eigenvalue distribution whose Gauchy transform G{z) is de- 
termined by 

Giz)=tTaigiiz)), 

where Qiiz) is an MalC) -valued analytic function on the upper complex 
half plane, which is uniquely determined by the facts that 

(5) lim zQi{z) = la, 

and that it satisfies for all z in the upper complex half plane the matrix 
equation 

(6) zg,{z) = ia + vi{{h-r]2{gi{z))y'ygi{z), 

where 

r]i : Mb{C) ^ M,(C) and r]2 : M„(C) ^ Mb{C) 
are the covariance mappings given by 

1 ^ 

(7) MD)]^^ := -—J2ri^,k■,J,l) - [DU 

k,i=i 

and 



a 



(8) [V2{D)li ■■=-^2^ r{t,k;j,l) ■ [D],,. 

The proof of this theorem will be given in Section [3l by reducing it 
to Theorem [3l 

In Section |4] we will use this to analyze the asymptotic eigenvalue 
distribution of HH* for the channel matrix from Eq. (j2]). 
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2.2. HH* for non-separable correlated fading. In [16], MIMO 
wireless systems under correlated fading were analyzed by asymptotic 
analysis of the eigenvalue distribution of H^H*, where the entries of 
the n X n random matrix H = l/^/n{hij)^J^l were assumed as jointly 
Gaussian with the following covariance structure: 

where \Ef^ and are Hermitian positive-definite matrices describing 
the transmit and the receive correlation, respectively. The assumption 
on \E'^ and is that both have a limiting eigenvalue distribution. 

We will now show how operator-valued free probability theory can 
be used to analyze a generalization of this to the case 

t 

(9) E[hpM = J2^f^^'pl 

s=l 

The number t of summands is here fixed and does not depend on n. 
As before, one needs the existence of the limiting joint distribution of 
the \&'s and the limiting joint distribution of the \l/'s. Mixed moments 
in \E' and ^' do not play a role for the result on HH*. 

This situation is treated in the next theorem, which we will prove in 
Appendix II, Section 16. 2[ Some of the basic notions from free proba- 
bility which are used in the formulation of the theorem are defined in 
Appendix I. As in |T6] we will restrict here, for notational simplicity, 
to the case of a square H. By invoking ideas from [T7j, one can also 
extend the results to rectangular H. 

Theorem 2. Assume that hij (i,j eN) are jointly Gaussian complex 
random variables with mean zero and covariance given by iQ for some 
t > 1 and some positive- definite matrices "^[j^ and '^['j' (s = 1, . . . ,t). 
We also assume circular complex Gaussian law, i.e, EKhrpY] = 0. 
We assume that, as n ^ oo, the [{"^^j), (^-j))^^-^ ^ converge in dis- 
tribution to some elements (\E's, ^s)s=i....,t i'n some non- commutative 
probability space {B,ip). 

We denote by Bi C B the algebra generated by "^i, . . . , \E't and by 
B2 <Z B the algebra generated by ^i, . . . , Furthermore we define 

t 

(10) Vi--Bi^ B2, Viib) := '^sV^ib'^s) 

s=l 
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and 

t 

(11) r]2:B2^Bi, r]2{b) := 



s=l 



We consider now 



Then the eigenvalue distribution of HnH* converges almost surely to 
a limiting distribution whose Cauchy transform G is given by G{z) = 
ip{Qi{z)), where Qi is the solution of the equation 
(12) 

Sl = l V S2 = l / 

One should note that the solution Q\{z) of the above fixed point 
equation lies in the algebra Bi and that its value does not depend on 
mixed moments between the \l/<('s and the \l/s's. By results from [18] 
(as outlined in Appendix I, Section [53]), there exists, for each z G C"*" 
a unique solution of equation f|T2l) with the right positivity property. 

Note also that Eq. f|T2]) reduces in the case t = 1 to the fixed point 
equation in Theorem IV. 2 in [T6] . 



3. Asymptotic eigenvalue distribution for selfadjoint 

BLOCK matrices 

Our Theorem [1] on the asymptotic eigenvalue distribution of HH* 
for a block matrix H follows from a corresponding statement for a 
selfadjoint block matrix X, which also has Gaussian entries with cor- 
relations. The reduction to the selfadjoint case can be achieved by the 
well-known trick of going over to 

H^ 

H* 



(13) X 



In this section we will state the selfadjoint version of Theorem [T] and 
show how it implies the result for HH*. 

3.1. Selfadjoint block matrices. Let us consider the selfadjoint ver- 
sion of Theorem [H We will here restrict to the situation where all 
blocks are square matrices of the same size. For some applications 
it might actually be better to allow also blocks of a rectangular size 
(which, of course, have to fit together to form a big square matrix). 
There is a straightforward generalization of the following theorem to 
that situation; we will state this in Appendix III. 
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Theorem 3. Fix a natural d and a "covariance function" a which 
satisfies 



(14) cx{i,j]k,l) = a{k,l;i,j) 

for alli,j,k,l = l,...,d. Assume, for N G N, that {orp^ 



, d, r,p = 1, . . . , N} are jointly Gaussian random variables, with 



a^f = for alli,j = l,...,d,r,p = l,...,N 

and the prescription of mean zero and covariance 

(15) E\a!^^a^'^] = ±6rs6,, ■ a{t, j; k,l). 

Consider now block matrices = {A^'^'^^)fj^-^ , where, for each i,j = 
1, . . . ,d, the blocks are given by A^*'-'^ = {arp^)^_^_^. 

Then, for N oo, the dN x dN matrix X^v has almost surely a 
limiting eigenvalue distribution whose Cauchy transform G{z) is deter- 
mined by 

(16) Giz)=tTd{giz)), 

where Q{z) is an Md{C)-valued analytic function on the upper complex 
half plane, which is uniquely determined by the facts that 

(17) lim zGiz) = Id, 

and that it satisfies for all z in the upper complex half plane the matrix 
equation 

(18) zg{z) = id + v{G{z))-g{z), 

where t] : M^(C) M^(C) is the covariance mapping 

1 

k,l=l 

The proof of Theorem [3] is given in Appendix II. Let us here just 
point out that the determining equation flTSl) is actually the equation 
for an operator-valued semicircular element; thus, one essentially has 
to realize that Xn converges to a suitably chosen operator-valued semi- 
circular element. 

Theorem [3] has also some interest of its own; for an application to 
some selfadjoint block matrix problems from [19\ see [20j. Here we will 
just use it to prove our Theorem [1] 
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3.2. Proof of Theorem [H Let us consider matrices as in The- 
orem [TJ For clarity of notation, we will in the following suppress the 
index A^. The calculation of the eigenvalue distribution of HH* can be 
reduced to the situation treated in the previous section by the following 
trick. Consider 

" H^ 

H* 



X 



With d = b + a, this is a selfadjoint dN x rfA^-matrix and can be viewed 
as a c? X d-block matrix of the form considered in Theorem [3l thus we 
can use this to get the asymptotic eigenvalue distribution of X. 

The only remaining question is how to relate the eigenvalues of X 
with those of HH*. This is actually quite simple, we only have to note 
that all the odd moments of X are zero and 



X' 



HH* 
H*H 



Thus the eigenvalues of are the eigenvalues of HH* together with 
the eigenvalues of H*H. (One might also note HH* is an aN x aN and 
H*H is an bN x bN matrix. Assuming that a < b (otherwise exchange 
the role of H and H*) we have then that the eigenvalues of H*H are 
the eigenvalues of HH* plus {b — a)N additional zeros. However, we 
will not need this information in the following.) 

So we should rewrite our equation for the Cauchy transform Gx of 
X in terms of the Cauchy transform Gx^ of X^. Since X is even, both 
are related by 

z-Gx^{z'')=Gx{z). 

By noting that the operator- valued Cauchy transform G{z) of X de- 
pends, up to an overall factor 1/z, only on z'^, we can introduce a 
quantity H by 

z-n{z') = g{z). 

Then with n = dN we have 



(20) lim Gx2iz)=tT4niz)], 

ra— >oo 

and the equation (ITS]) for Q becomes 

(21) zn{z) = id + z7]{n{z))-n{z). 

It is fairly easy to see that the covariance mapping r] : Mb+a(C) 
Mfe+a(C) of X splits according to 

77 : 







'^1(^2) 





D2 


1 — !> 
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where 

r/i : M,(C) ^ MaiC) and r^2 : M,(C) ^ M,{C) 

are the two covariance mappings for H as in Theorem [H Therefore, 
our (6 + a) x (6 + a) matrix 7i decomposes as a 2 x 2-block matrix 

Qi{z) 

6?2(^)_ 

where and Q2 are Ma(C)-valued and Mb(C)-valued, respectively, 
analytic functions in the upper complex half plane. Then one has 

(22) lim GHH'{z)=iia{Qi{z)). 
and 

(23) lim GH'H{z)=tn{g2{z)). 

The equation ( l2Tl) for Ti splits now into the two equations 
2:^1(2;) = Ia + zrji (^2(2)) ■ Qi{z) 

and 

zG2{z) = h + zri2{Gi{z)) ■ Q2{z). 
One can eliminate Q2 from those equations by solving the second equa- 
tion for Q2 and inserting this into the first equation, yielding Eq. ([6]). 

4. Results and Discussion 

Our theorems give us the Cauchy transform G of the asymptotic 
eigenvalue distribution HH* of the considered matrices in the form 
G{z) = tTr{Qi{z)), where Qi{z) is a solution to the matrix equation (Ej) 
or (fT2l) . Usually, it is more convenient to deal with the equation ( 12T1) 
for the corresponding selfadjoint matrix X. 

We recover the corresponding eigenvalue distribution n from G in 
the usual way, by invoking Stieltjes inversion formula 

1 

(24) diJ,(x) = lim '^G(x + ie)dx, 

where the limit is weak convergence of measures. 

Usually, there is no explicit solution for our matrix equations, so that 
we have to rely on numerical methods for solving those. Note that we 
do not get directly an equation for G. We first have to solve the matrix 
equation, then take the trace of this solution. Thus, in terms of the 
entries of our matrix Qi or 7i, we face a system of quadratic equations 
which we solve numerically, either by using Newton's algorithm ^21j or 
by iterations as in Eq. (13T!) . 
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4.1. Example: ISI channel matrix. In this section we want to spec- 
ify our general theorems to the case of the ISI channel matrices as 
appearing in Eq. ([2]). For simplicity we treat the case of square blocks. 



4.1.1. Proposition. Let be the channel matrix from Eq. ([2]) with 
nR = riT ='■ N, such that each entry has variance 1. Put d = 
2K + L — 1, n = Nd. As N ^ oo the spectral law of Hj^H*j^/n 
converges with probability one to a deterministic probability measure 
which is a mixture of K densities with Cauchy transform 

1 ^ 

(25) lim GHH'/n{z) = -Y.f^^'^y 

Af— >oo i\ ' 

Functions fj are each a Cauchy transform of a probability measure and 
the following conditions hold. 

(1) /, = fK+l-j i0Tl<3<K 

(2) The diagonal matrix Qi = diag(/i, . . . , /x) satisfies equation 

with r]i : Mk+l~i{C) Mk{C) given by 

1 

(26) [r^i(D)],, = l<z,j<K 

k=i 

and with r/2 : Mk{C) Mk+l-i{'C) such that on the diagonal 
we have 

(27) 

^ min{j,/C} 

i^^(D)],, = E \DUk,+k, 1<J<K + L-1. 

k=max{l,j—L+l} 

Proof. We note that the only non-zero values of r are T{i, j; k, j + k — 
i) = 1 when l<i,k<K,i<j<i + L — 1. Therefore gives ( l26l) 
and (ED gives (1271). 

From (l26l) and (1271) we see that ?7 maps diagonal matrices into diag- 
onal matrices, so the solution H of equation (12T1) must be diagonal, 

n{z) = diag(/i, /2, . . . , /i^, ^1, ^2, • • • , 9k+l-i)- 

We now note that the symmetry conditions fj = fx+i-j and gj = 
gx+L-j are preserved under the mapping D 1^ + ■ D, therefore 
the same symmetries must be satisfied by the solution Ti. Thus Qi = 
diag(/i, . . . , fx) satisfies and fj = fx+i-j as claimed. □ 
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4.1.2. Example. As a concrete example we consider a MIMO system 
with ISI (L = 4) and frame size of 4 {K = 4): 



f28) 



N 



A B C D 

A B C D 

A B C D 

A B C D 



where A, B, C, D are independent non-selfadjoint Gaussian x A^- 
random matrices. It is also assumed that the impulse response of the 
channel from any transmitter antenna to any receiver antenna is iden- 
tical and equal to [ 1 1 1 1 ] . In this case A' = L = 4, 

6;i(^) = diag(/i(^),/2(^),/2(^),/i(^)), 

[^iM^ = YY^Zt^]^-^- for z = 1,2, 



1 



V2{Qi) = YYdiag(/i, /i + /2, /i + 2/2, 2/i + 2/2) 



and 



\ yields the following system of equations. 
Ill 1 

A "^TT^"^ 11-/1-/2"^ 

1 1 2 



1 



11-/1-2/2 11-2/1-2/2 



+ 



1 



/1-/2 11-/1-2/2 11-2/1-2/2 

The limiting Cauchy transform is Ghh*{z) = (/i + /2)/2. We use 
Newton's algorithm to solve this quadratic system of equations; the 
match between this solution and simulations is shown in Fig. [21 

4.2. Convergence speed of capacity. The results developed in this 
manuscript are good assets to study the asymptotic behaviour of slow- 
fading non-separable correlation MIMO channels when N 00 but the 
authenticity of these results for limited A^ is also of interest in practice. 

In this subsection, the asymptotic capacity of a slow-fading MIMO 
channel with L = 2 and the frame length of A' = 2 in different SNR 
is compared with the capacity of such a channel for several A^. The 
channel matrix for this system is as follows: 



H 



ABO 
A B 



and the results are depicted in Fig. [31 As the figure shows, with 
increasing the size of the blocks, the system capacity fast approaches 
the asymptotic capacity, suggesting a reasonable match between the 
asymptotic capacity and the capacity with a block size of 10 and bigger. 
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5. Appendix I: Prerequisites 

5.1. Notations. The following notations are used in the paper: 
Mrf(C) complex d x d matrices 

Mci{A) d X d matrices with entries from the algebra A 

[D]ij i, j-entry of the matrix D 

tTd normalized trace on Md(C) 

9 (X) Imaginary part of X 

III d X d Identity matrix 

id identity operator on a Hilbert space 

X complex conjugate of X 

5ij Dirac delta function 

X* Hermitian conjugate of matrix X 

C"^ complex upper half plane 

The Cauchy transform of a probability measure on R is defined by 
G{z) = f -^dii{t) {z e C+). 

5.2. (Operator-valued) non-commutative probability spaces and 
freeness. A pair [A, (p) consisting of a unital algebra and a linear 
functional (p : A^ C with (p{l) = 1 is called a non-commutative prob- 
ability space. If S is a subalgebra of A, then a mapping E : A ^ B is 
called a conditional expectation if we have for all a e ^ and bi,b2 & B 
that 

E[biab2] = biE[a]b2. 

An algebra A with a conditional expectation onto a subalgebra B is 
called a B-valued probability space. 

If we are given such a i3- valued probability space then we say that 
unital subalgebras Ai G A {i E I) are free over B (or with respect to 
E) if the following is satisfied: whenever we have G A such 

that Gj e Ai(j) . . .,i{n) e I) with i(l) i{2), i{2) ^ i(3), . . . , 

i{n — 1) ^ i{n) and with E[aj] — for all j' = 1, ■ ■ ■ , n, then we also 
have that E[ai ■ ■ ■ an] — 0. In the case that B — C (i.e., E is just a 
linear functional ip) we say that the Ai are free. 

Elements in A are called free (over B), if the algebras generated by 
them are free (over B) ; they are called *-free (over B) , if the *-algebras 
generated by them are free (over B). 

5.3. Convergence in distribution. Let {An,'Pn) {N G N) and {A, cp) 
be non-commutative probability spaces. Let / be an index set and con- 
sider for each i E I random variables a^^ E An and Oj G A. We say 
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that {a^^)i(zj converges in distribution to {ai)i^i and denote this by 

/ distr / X 

if we have that each joint moment of {cifj)i^i converges to the corre- 
sponding joint moment of (ai)jg/, i.e. if we have for all n G N and all 

(29) lim v?iv(aS^^^^^ ■ ■ ■ aS^^"-"^) = ^{am) ■ ■ ■ ai(„)). 

We say that (a^'*)jg/ converges in *-distribution to (aj)jg/ if (aj^-*, a{l*)i^i 
converges in distribution to (oj, a*)jg/. 

5.4. Operator-valued semicircular elements. Let {A, E : A ^ B) 

be a i3- valued probability space and let, in addition, be given a linear 
mapping rj : B ^ B. Then an element s G ^ is called a S-valued 
operator- valued semicircular element with covariance mapping t] if one 
has E[sbs] = r]{b) for all 6 G i3 and, more generally, for all m G N and 
all 6i, . . . , &m-i £ B that 

E[sbis ■ ■ ■ sbm-is] = r]^[bi,...,bm-i], 

TTeNC2{m) 

where NC2{'m) are the non-crossing pairings of m elements (for details 
on non-crossing pairings in the context of free probability see [7]) and 
where r^jr is given by an iterated application of the mapping r] according 
to the nesting of the blocks of vr. If one identifies a non-crossing pairing 
with a putting of brackets at the positions of the s's, then the way that 
Tj has to be iterated is quite obvious. To make this clear, let us consider 
as an example just the contribution of the five non-crossing pairings of 
six elements to the sixth moment. The latter is given by 

E[s6is62sfe3S&4 565-5] = ri{hi) ■ 62 ■ 77(63) ■ 64 ■ ri{b^) 

+ ri{hi) ■ 62 ■ 77(63 ■ ^(64) ■ 65) +ri{bi- 77(62 ■ 7/(63) ■ 64) ■ 65 

+ 77(61 • 77(62) • 63) ■ 64 ■ 77(65) + 7/(61 ■ ^7(62) ■ 63 ■ 77(64) ■ 65) 



corresponding to: 



sbisb2sb^sb/isb# 

u u u 



sbisb2sb-isbisb^ 

U 



77(61) ■ 62 ■ 77(63) ■ 64 ■ 7/(65) Tl{bi) ■ 62 • 77(63 ■ 77(64) ■ 65) 
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sbisb2sbssb4sb^ 

U 



sbisb2sbzsbisb# 

U U 



r]{^i ■ Vih) ■ bs) ■ bi ■ r]{b^) r]{bi ■ 77(62) ■ 63 ■ ^?(&4) ■ 65) 



S61S62S63S64S65S 

U 



r]\bi ■r]{b2- r]{b^) ■ 64) ■ 65 j 

For the rigorous definition of r/jr and more details on operator- valued 
semicircular elements, we refer to |22j . 

In the situations which are relevant to us, the algebras A and B 
are operator algebras of bounded operators on Hilbert spaces. In such 
a case, the main statement about an operator-valued semicircular ele- 
ment s is the following description of its operator- valued Cauchy trans- 
form. Define 

g:C+ ^B, G{z) ■.= E[^]. 

z — s 

This is an analytic map in the upper half plane and it is, for any z G C"*", 
determined by the operator-valued quadratic equation 

(30) zg{z) = id + 7]{g{z))-g{z). 

For a derivation and details on this, see [231 [22] • In [IB] it is shown 
that Eq. ( 130|) has for fixed z G C"^ exactly one solution Q with negative 
imaginary part; furthermore, this solution is the limit of iterates Qn = 
jF"(^o) for any initial point Qo with negative imaginary part. J-'z is 
here the mapping 

(31) j'z{g) = {z-id-r]ig))-\ 

6. Appendix II: Proof of the main theorems 

6.1. Proof of Theorem [31 There are several alternative methods of 
proof of Theorem [3l It can be derived from Girko [23] by specializing 
his Theorem to a block matrix with iV^ blocks of size d x d obtained 
from our matrix by a suitable similarity transformation. It can be 
derived by elementary method of moments, see [20]. We choose here to 
give a proof by using various results from the theory of operator- valued 
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free probability, thus showing how this resuh fits conceptually into the 
frame of operator- valued free probability. The connection between ran- 
dom matrices and operator- valued free probability (for "band" random 
matrices, with independent entries but variances depending on the po- 
sition of the entry) was made by Shlyakhtenko in [251 126] . 

First, one has to observe that the blocks of Xn converge almost 
surely to a semi-circular family (see O EJ [271 [28] ) , thus the wanted limit 
distribution of X^v is the same as the one of a d x (i-matrix S, where the 
entries of S are from a semi-circular family, with covariance a. By using 
the description of operator-valued cumulants of this matrix in terms of 
the cumulants of the entries of the matrix (see [22]), it is readily seen 
that 5* is a Md(C)-valued semi-circular element, with covariance rj. The 
equation for G{z) follows then from the basic /^-transform or cumulant 
theory of operator-valued free probability theory, see Sect. 15.41 above, 
in particular Eq. (|30|) . 

6.2. Proof of Theorem [2l If we decompose the positive definite ma- 
trices \1>('') and ^(''^ as '^^^'^ = and "^^-'^ = Bl (where we take the 

positive square roots Ag = and Bg = \/\l/(*)) then our n x n 

matrix H„ can be written as 



where Zi, Zt are independent nxn matrices of independent complex 
Gaussian variables. 

By our assumption on the convergence of (\l/*^*\ '^^'^^)s=i,...,t "we know 
that also {Ag, -Bs)s=i,...,t converges in distribution to (a^, bs)s=i,...,t, where 
ttg = and bg = \/^. By the asymptotic freeness of Gaussian ran- 
dom matrices from non-random matrices [3 [TJ [HI [28] we know then 
that (As, Zs)s=i,...,t converges in ^-distribution to (a^, 6<j, Cs)s=i,...,t 
in some {A, f), where ci, . . . , q are >K-free circular elements such that 
ai,bi, . . . ,at,bt is *-free from ci, . . . , q . (A circular element is of the 
form c = Si + is2 where Si, S2 are free semicircular elements.) By B we 
denote, as in our theorem, the subalgebra of A which is generated by 
all ai, &i, . . . , at, h. 

Then Hn converges in ^-distribution to 



Hn = ^ AgZgB, 



s 



s=l 



H 




s=l 



16 



R. RASHIDI FAR, T. ORABY, W. BRYC, R. SPEICHER 



and HnH* converges to HH*. To calculate the distribution of HH* we 
go again over to the self adjoint 2x2 matrix 



X 



H 

H* 



E 

s=l 





bsC*as 







E 

s=l 



o-s 
6., 



Cs 
c! 



Q-s 
6., 



The relation between the distribution of X and the distribution of 
HH* is as in Section 13.21 thus it remains essentially to determine the 
distribution of X. 
Put 

a., 



and 



so that we have 



A. 



k 






X — ^ ^ AgSgAg 



s=l 

The main problem is now that the different terms AgSsAg in X are 
not free and thus one cannot reduce the situation directly to the case 
t = 1. However, we have operator- valued freeness with respect to 
a suitably chosen conditional expectation. Namely, let us first take 
the conditional expectation E from A to B (which exists by general 
arguments, because we are in a tracial situation, see, e.g., |23j) and 
then we go over to 2 x 2 matrices by taking this E entrywise, i.e. we 
consider 

E : M2{A) ^ M2{B) 

given by 

'E{a,) E{a2) 
E{as) E{a^) 

From Theorem 3.5 in [29j it follows now that, for each s = 1, . . . ,t, 
AsSgAs is a semicircular element over M2{B), and furthermore, that 
all AiSiAi, . . . , AtStAt are free over M2{B). But this implies that also 
their sum X is a semicircular element over M2{B). It remains to cal- 
culate its covariance function. We have 



10E 


ai 


a2 






as 







r]{D) = 1^E{XDX), 



i.e., for di, d2, d^, d^ E B 

di ds _ sr-^ 
^ d,A d,n 2-^ 



E[aiCibid2bjC* aj ] [a j c, 6 j (^4 aj Cj bj ] 
E[biC*aidsbjC* aj ] E[biC*aidi aj Cj bj ] 
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It is quite easy to see that the conditional expectation E : A ^ B acts 
for all b E B as 

E[cibc*] = 5ijip{b) 



E\c*bc, 



E[clbc] 
E[cibcj 



Thus 



V 





ds 




(^4 


d2 





XlLi aiai'^(bid2bi) 




5ijip{b) 
1=0 
= 





Y!i=i bibi(f{aidiai) 



V2{d2) 







Vi{di] 



where Bi is the algebra generated by of, 



5 



(i.e., the algebra gen- 



erated by . . . , \Eft) and B2 is the algebra generated by 6f , . . 
(i.e, the algebra generated by \Pi,...,\^f) and rji : Bi ^ B2 
V2 '■ B2 ^ Bi are the mappings as in our Theorem. 
Denote by T> the subalgebra of M2{B) of the form 

'Bi 



and 



V 



Bo 



We see that 77 maps P to itself. Then it follows by Theorem 3.1 of [29] 
that X is also a semicircular element over V, with the same r^. This 
implies then that our corresponding operator- valued Cauchy transform 
Q{z) lies in V, thus is of the form 

\Qi{z) 

g2(z) 



where Gi{z) G Bi and Q2{z) G B2- The rest follows then from analyzing 
the corresponding operator- valued quadratic equation ( l30l) for ^ {z) and 
relating it with the Cauchy transform of HH* as in Section 13. 2[ 

7. Appendix III: Selfadjoint case with rectangular blocks 

In some applications one encounters situations where the blocks 
themselves might not be square matrices, but more general rectan- 
gular matrices. Of course, the sizes of the blocks must fit together to 
make up a big square matrix. This means that in Theorem [T] we replace 
n = dN by a decomposition n = Ni + ■ ■ ■ + N^, and the block A^^'^'^ 
will then be a A^j x A'j -matrix. We are interested in the limit that Ni/n 
converges to some number ttj. 

Let us first introduce the generalizations of our relevant notations 
from the square case. Note that dependent rectangular blocks can be 
re-cut into different nonequivalent configurations of dependent blocks. 
We will assume that such repartitioning has already been done and 
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resulted in the covariance function k, I) that can only be different 

from zero if the size of the block A^'^'^^ fits (at least in the limit n oo) 
with the size of the block A^'''^\ 

Notation 4. Fix a natural number d and a d-tuple a = {ai, . . . , a^) 
with < < 1 for alH = 1, . . . , d and ai + ■ ■ ■ + 0;^ = 1. Furthermore, 
let a covariance function a = {a{i^ j;k^l)) ^ . be given with the 
property that holds and in addition <j{i,j; k,l) = unless = ai 
and aj = a^- Then we use the following notations. 

1) Mq,(C) are those matrices from M^(C) which correspond to square 
blocks, 

M„(C) := [D e Md{C) I [D]ij = unless = aj}. 

2) We define the weighted covariance mapping 

: M,(C) M,(C) 

as follows: 

d 

[Va{D)]ij := a{i, k; I J) ■ Uk ■ [D]ki. 

k,l=l 

3) Furthermore, the weighted trace 

tr„ : M„(C) ^ C 

is given by 

d 

ti^{D) := Xl"^ ■ 

i=l 

The following statement for rectangular blocks can be reduced to 
the case of square blocks by cutting the rectangular blocks into smaller 
square blocks (at least asymptotically); for a more direct combinatorial 
proof, see [20] . 

Theorem 5. With the above notation, for {Ni, . . . , N^} C N consider 
block matrices 

For each i,j = 1, . . . ,d, the A^^'^^ are Gaussian Ni x Nj random ma- 
trices, (cLrp^^^ I— i,...,]Vj ■ The latter are such that the collection of 

P=l,....iV, 

all entries {arp^ \ i,j = 1, . . . ,d, r = 1, . . . , Ni,p = 1, . . . , Nj} of the 
matrix XjVj^...^7Vd forms a Gaussian family which is determined by 

al'^^^ = ap/^ for all i, j = 1, . . . ,d, r = 1, . . . , Ni, p = 1, . . . , Nj 
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and the prescription of mean zero and covariance 

E[a^fa^^/'^] = ^SrsSpg ■ j; k, I), 

where we put 

n:=Ni + ---Na. 
Then, for n ^ oo such that 

lim — - = ai for all i = 1, . . . , ci, 

n^oo n 

the matrix XN^^,,,^!<4a has almost surely a limiting eigenvalue distribution 
whose Cauchy transform G{z) is determined by 

where Q{z) is an MaiC) -valued analytic function on the upper complex 
half plane, which is uniquely determined by the facts that ( fT7|l holds 
and that it satisfies for all z in the upper complex half plane the matrix 
equation 

(32) zgiz) = id + VaiGiz))-giz). 
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channel impulse response ^7 21 

between TXl and RX2: [h h h ■ 



Figure 1. Block diagram of a MIMO system with ISI. 




Figure 2. Superimposed theoretical density of the 
eigenvalues of complex normal HnH*/n for a channel 
with ISI L = 4 and a MIMO system ur — ut with 
frame length of T^' = 4 over its histogram for N — 100, 
based on 100 realizations. 
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Figure 3. Asymptotic capacity (solid line) of the chan- 
nel with ISI, L=2, in a MIMO system with frame length 
K=2 compared with the capacity of the same channel for 
different block sizes (dots). 
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